Assessment for Learning (AfL) may be conceptualized as minute-to-minute, day-by-day interactions between learners and teachers with the improvement of learning as the principal focus. This paper traces the development of an AfL measurement instrument (scale) that can be used for research purposes prior to, during and following professional development in the area. Rasch measurement procedures were applied to data drawn from a convenience sample of 594 teachers from 44 elementary schools in Ireland to create a scale consisting of 20 items distributed across four key AfL assessment strategies: learning intentions and success criteria, questioning and classroom discussion, feedback, and peer-and self-assessment.  This scale, the Assessment for Learning Measurement instrument (AfLMi), has good psychometric properties and is interpretable in a way that makes it potentially useful during system wide improvement initiatives focused on AfL.

This research was conducted in order to determine whether math anxiety was effective in the selection of secondary school students. This research, in which the mixed method was adopted, was conducted in a secondary school at Siirt. The participants (157 pupils) were determined by convenient sampling method from the four different classes (two 5th grade and two 8th grade). Math anxiety levels of the students were determined by the Mathematics Anxiety Scale. Sociometry technique was used to determine the informal friends groups in each class. For this purpose, a friend preference form was used. Students' friends preferences were transformed into data matrix and Hierarchical Clustering Analysis was used to form informal friends groups for each class. Math anxiety scores of informal groups were compared with Kruskal Wallis test. Accordingly, there were significant differences between the mathematical scores of the informal groups in the branches of the 5th and 8th grades. This finding was evaluated that mathematics anxiety may be a factor in the selection of friends.  

Positive attitude towards statistics is a desirable aspect in developing statistical thinking and understanding statistical concept. The attitude towards statistics instrument in previous study on rural school students lacked evidence in the validity analysis. Therefore, there is a need to provide a valid instrument that can assess rural secondary school students’ attitude toward statistics. For this purpose, this study was carried out to investigate the validity and reliability analysis of the Survey Attitude towards Statistics (SATS-36) instrument from a sample of rural secondary school students. The SATS-36 is a 7-point Likert type scale questionnaire, used to measure students’ attitude towards statistics. The SATS-36 instrument was distributed to 217 Tenth grade science stream students from a rural district in Sabah, Malaysia, which comprised of 66 (30.4%) boys and 151 (69.6%) girls. A second order Confirmatory Factor Analysis (CFA) was carried out to analyze the validity of the SATS-36 instrument as well as to confirm the 6-factor model of SATS-36. The reliability of SATS-36 instrument was assessed through the Cronbach’s Alpha value. Overall, the analysis showed that the SATS-36 instrument shows favorable indices for both its validity and reliability. Thus, it can be concluded that the SATS-36 was a valid and reliable instrument for measuring students’ attitude towards statistics among rural science stream secondary school students.

Two new instruments were created to assess secondary students’ (ages 14-18) spatial learning attitudes and their interest in science and technology, related careers ideas and perceptions about geospatial technologies. These instruments were designed to evaluate the outcomes of a geospatial learning curriculum project. During a two-year period, we explored the use of these instruments during the prototype testing and pilot testing of a series of socio-environmental science investigations. The instruments were implemented with 664 ninth grade urban students from a population traditionally underrepresented in STEM-related fields. Both classical and Rasch analyses were conducted each year to optimize the instruments. The resulting 24-item Student Interest in Science, Technology and Geospatial Technology (STEM-GEO) measure and 9-item Spatial Learning Attitudes (SLA) measure had high internal consistency reliabilities (Cronbach’s Alpha) as well as acceptable Rasch reliabilities. Content validity and construct validity evidence were also summarized and discussed.

Kelley’s Discrimination Index (DI) is a simple and robust, classical non-parametric short-cut to estimate the item discrimination power (IDP) in the practical educational settings. Unlike item–total correlation, DI can reach the ultimate values of +1 and ‒1, and it is stable against the outliers. Because of the computational easiness, DI is specifically suitable for the rough estimation where the sophisticated tools for item analysis such as IRT modelling are not available as is usual, for example, in the classroom testing. Unlike most of the other traditional indices for IDP, DI uses only the extreme cases of the ordered dataset in the estimation. One deficiency of DI is that it suits only for dichotomous datasets. This article generalizes DI to allow polytomous dataset and flexible cut-offs for selecting the extreme cases. A new algorithm based on the concept of the characteristic vector of the item is introduced to compute the generalized DI (GDI). A new visual method for item analysis, the cut-off curve, is introduced based on the procedure called exhaustive splitting.

Progress monitoring of academic achievement is an essential element to prevent learning disorders. A prominent approach is curriculum-based measurement (CBM). Various studies have documented positive effects of CBM on students’ achievement. Nevertheless, the use of CBM is associated with additional work for teachers. The use of tablets may be of help here. Yet, although many advantages of computer- or tablet-based assessments are being discussed in the literature (e. g. innovative item formats, adaptive testing, automated scoring and feedback), there are still concerns regarding the comparability of different assessment modes (paper-pencil vs. tablet). In the study presented, we analyze the CBM data of 98 fourth graders. They processed the exact same computation items once with paper and pen and once in a tablet application. The analyses point to comparable results in the test modes, although some significant deviations can be found at item level. In addition, the children report perceived benefits when working with the tablet.

Although Goodman–Kruskal gamma (G) is used relatively rarely it has promising potential as a coefficient of association in educational settings.  Characteristics of G are studied in three sub-studies related to educational measurement settings. G appears to be unexpectedly appealing as an estimator of association between an item and a score because it strictly indicates the probability to get a correct answer in the test item given the score, and it accurately produces perfect latent association irrespective of distributions, degrees of freedom, number of tied pairs and tied values in the variables, or the difficulty levels in the items. However, it underestimates the association in an obvious manner when the number of categories in the item is more than four. Towards this, a dimension-corrected G (G2) is proposed and its characteristics are studied. Both G and G2 appear to be promising alternatives in measurement modelling settings, G with binary items and G2 with binary, polytomous and mixed datasets.

The purpose of the study is to examine pre-service teachers' impromptu speaking skills on the basis of the evaluations of the instructor, peers and their own. The study employed a descriptive case study design, one of the qualitative research methods. A total of 23 pre-service math teachers taking the course of Art of Effective Speech in a state university in Turkey in the 2016-2017 academic year participated in the study. The data of the study were collected through the observations of the researcher and pre-service teachers. Descriptive analysis was used in the analysis of the data. As a result of the study, it was found that in most of the observation items, the pre-service teachers found themselves inadequate in terms of impromptu speaking skills while they were found to be adequate by their peers and instructor. In addition, it was revealed that the pre-service teachers found themselves inadequate in some items related to the use of voice while they found themselves adequate in most of the items related to articulation/diction and body language and in all of the items related to communication. However, while the instructor observed that the pre-service teachers were generally competent in all the sub-dimensions, she determined that they needed improvement in the sub-dimensions of eye contact, pausing at the appropriate place and speaking without repeating words.  

This study aims to produce empirical evidence of the validity and reliability of instrument items for the competency framework of agricultural teaching staff in Malaysian agricultural vocational colleges. The validity and reliability of the framework were analyzed using Rasch Model Measurement assisted by Winsteps 3.72 software. This research instrument contained 116 items, which was distributed to 30 instructors at the Teluk Intan Agricultural Vocational College, Malaysia. The selection of respondents was made by strata random where the researcher makes the strata of the population according to the percentage and then selects randomly based on the desired percentage. Validity analysis of the instrument was done through four functional testings. For reliability and separation of respondents, it was found that the individual reliability value was very good and acceptable. The results of the item polarity analysis detected no negative value (-) in the Point Measure Correlation value. Item matching analysis found that 11 items had to be dropped as they failed to meet the required conditions. From the analysis on local dependence that determines dependent items based on the standardized residual correlation value, it was discovered that the correlation value for the items used was detected; 13 items need attention. The results of the data analysis checking the functionality of the items suggested that some items should be dropped. The omission of these items has provided evidence that the instrument of competence of agricultural instructors is crucial to have a high level of validity and reliability for use in actual studies.

This study aimed to develop an instrument to assess science teacher candidates’ professional and pedagogical competence in the Industrial revolution 4.0. The instrument consisted of 30 questions and was used in the main study, which was analyzed using the Rasch model to unravel the reliability and empirical validity. The questions were developed based on a predetermined grid including the skills and literacy aspects used in the industrial revolution 4.0. The 30 revised questions were then tested on 60 students of Science Education at two State universities in Indonesia who were in their third year of study times. The Rasch model was employed to test its reliability and empirical validity that included Wright map analysis, item difficulty level, distractor analysis, and item suitability with the Rasch model. The results showed that the reliability value of the professional aspect was .95 and classified as an excellent category. Moreover, the pedagogic aspect obtained .93 and was classified as a very good category. Only one question was the most difficult and did not fit the Rasch model, while the others already fitted. This reliable and valid instrument is suggested to be useful in assessing pre-service science teachers’ competence.

There are different strategies to analyze teacher and student performance when they interact with each other in class. The most used strategies are direct observation and verbal reports. Even though what is observed or reported depends on theoretical frameworks regarding didactic interactions, these must be related to teacher functions such as supervision, providing feedback, and evaluation of student performance. In this study, instruments for observational recording and verbal reports were developed and validated considering teacher functions and their student performance counterparts to compare the degree of correspondence or divergence between data gathered from both strategies. 135 students enrolled in a science class and their teachers participated. The class was taught in a public high school located in center/south Mexico. Classes were videotaped and the corresponding observational records were analyzed. Two months later, verbal reports were administered to students and teachers. Coincidences and differences that were found revealed that observer-observe interaction is conditioned by social norms. These results were interpreted considering the notion of silence as a communicative element.

This research analyzed the involvement of teachers, parents, and school committees in improving scientific attitudes in science learning using Rasch model analysis. A survey method was used in this quantitative study. Participants in the study were selected using a purposive sample of 174 teachers, parents, and school committees in Sleman and Kebumen Regencies, Indonesia. A questionnaire was used in data collection to determine the involvement of teachers, parents, and school committees in improving scientific attitudes toward science learning. The questionnaires were completed using a Likert scale of 1-4, and the data were then analyzed using the Rasch model. The result showed that all participants were the average logit items (+1.03 logit). The reliability was 0.89, indicating a positive response to improving students' scientific attitudes. The results of the Rasch model analysis suggested that the involvement of parents, teachers, and school committees in improving scientific attitudes differed according to their roles. Each instrument element was analyzed in more detail in the Rasch model. Participants' roles were reflected in the specific involvements of teachers in learning, parents at home with children, and school committees participating in school policy-making.

The purpose of this study was to establish the factor structure and dimensionality of the Metacognitive Orientation Learning Environment Scale – Science (MOLES-S) in the Thai context. The metacognitive orientation of a science classroom learning environment is defined as the extent to which psychosocial conditions that are known to enhance students’ metacognition are evident in a specific science classroom. This study builds on earlier work in the research areas of science education, metacognition, and learning environments. A sample of 5418 Thai science students in grades 10 to 12, from 40 schools across Thailand, completed the MOLES-S that had been translated into Thai. Exploratory factor analysis was undertaken and Rasch analysis was used to calibrate the scale and explore its dimensionality. The results suggest that the MOLES-S(T), where (T) represents Thailand, has the same factor structure as the original MOLES-S, is reliable, and can be used with confidence in research into metacognition in Thai high school science classrooms.

Curiosity is one of the most important characters for elementary school students. However, the facts in the field show that the measurement model used by the teacher to identify the student's curiosity is not yet available in a standardized manner. This study aims to develop a model for measuring the curiosity of elementary school students using the graded response model (GRM) approach. This research uses quantitative method with descriptive type. The research sample used was 236 elementary school students who were randomly selected. Data were collected using a questionnaire of 16 statement items using a Likert scale approach. The data were analyzed using the response item theory approach with the GRM. The results showed that the model for measuring student curiosity in elementary schools had good location parameters, a good discriminant index, a fairly good information function with a small estimation error. The curiosity measurement model in this study can be used as an alternative for teachers to identify students' curiosity in elementary schools.

This study aims to examine the 9th-grade 2018 physics curriculum according to various criteria. A cross-sectional survey model was used. The sample consists of 36 physics teachers working in various high schools in 12 regions of Turkey in the 2022-2023 academic year. The data of the study were collected via the “9th-grade 2018 physics curriculum Evaluation Form”. The data collected via the evaluation form were determined with the multilevel Rasch analysis program. The results of the research revealed that the criteria determined in the evaluation of the 9th-grade physics curriculum differed in terms of strictness and generosity. In addition, the quantitative data analysis revealed that the physics teachers mostly comply with the criteria set in the program while they disapprove of some criteria. The physics teachers reported some deficiencies in the objectives, content, and educational status of the elements included in the program. In this context, it is recommended that the achievements of the 9th-grade 2018 physics curriculum be reviewed in line with the evaluations of the stakeholders related to the subject.

The purposes of this research are (a) to make an instrument to measure the achievement of project-based digitalpreneurship learning in students; (b) to describe the quality of the project-based digitalpreneurship learning achievement assessment instrument for vocational high school students; (c) to measure the competence and skills. This study employed to research and development as its methodology, using a combination procedure between Oriondo and Antonio and, Mardapi. The development procedure includes three stages: instrument design, instrument testing, and measurement. A total of 795 students who participated in the study at 5 vocational high schools in Yogyakarta's special region served as responders. Data analysis in this development uses the content validity of the formula Aiken V Index, confirmatory factor analysis establishes the construct's validity, and construct reliability. Measurement instrument development. Research findings that (a) the instrument is ready to be used in the measurement; (b) the quality of the project-based digitalpreneruship learning achievement assessment instrument for vocational high school students is well tested. This is evidenced by the validity test which has a high score >.8; The proof of construct validity in this study using CFA > .5; GOF chi-square value with a critical value of df = 289, X2 = 323, p-value with a critical value of .079, RMSEA with a critical value of RMSEA .019 (≤ .08), SMRM with a critical value of SRMR 0.030 (≤ .05), CFI with a critical value of CFI .990 (> .97), and an NFI with a critical value of NFI .989 ( > .90); (c) the measurement results are identified in the process that needs to be improved again regarding the digitalpreneurship skills of vocational high school students.

This research article focuses on the design and validation of a questionnaire to analyse future teachers' perceptions of professional skills through the use of Augmented Reality (AR) in higher education, specifically for students in the field of Educational Sciences. The sample consisted of 575 students of Early Childhood Education, Primary Education and Pedagogy during the academic year (2021/2022). The focus of this study is to authenticate a questionnaire that measures the influence of Augmented Reality (AR) on aspects such as situated learning, motivation, and the necessary instructional preparations for the successful integration of AR within classroom educational encounters. The questionnaire is an online Likert-type scale developed based on three dimensions: situated learning, motivation and training. The data were analysed using the Statistical Package for the Social Sciences (SPSS) version 25 and JASP 0.17.1. The questionnaire met the standards recommended for validation. However, improvements to the instrument are suggested. In conclusion, validation of instruments is necessary to gain a rigorous understanding of the impact of new learning environments.

The role of artificial intelligence (AI) in education remains incompletely understood, demanding further evaluation and the creation of robust assessment tools. Despite previous attempts to measure AI's impact in education, existing studies have limitations. This research aimed to develop and validate an assessment instrument for gauging AI effects in higher education. Employing various analytical methods, including Exploratory Factor Analysis, Confirmatory Factor Analysis, and Rasch Analysis, the initial 70-item instrument covered seven constructs. Administered to 635 students at Nueva Ecija University of Science and Technology – Gabaldon campus, content validity was assessed using the Lawshe method. After eliminating 19 items through EFA and CFA, Rasch analysis confirmed the construct validity and led to the removal of three more items. The final 48-item instrument, categorized into learning experiences, academic performance, career guidance, motivation, self-reliance, social interactions, and AI dependency, emerged as a valid and reliable tool for assessing AI's impact on higher education, especially among college students.